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ABSTRACT 

Pictures or imagery are a highly effective form of commu- 
nications. While plans are progressing for introduction of 
individual video screens at passenger seals in commercial 
airlines, less attention has been directed at the possibilities 
of picture delivery for enhancement of command and con- 
trol, flight safety, and operational communications to the 
flight deck; that is, the presentation of critical information 
to flight crews as imagery and graphics rather than as voice 
(audio) or text message displays. 
The term cockpit vision is tneant to imply a threefold 
meaning: the introduction of visual displays, the resulting 
enhanced pilot vision of the aircraft environment, and the 
visionary application of technology to flight deck commu- 
nications. This paper provides a concephral outline of the 
application of emerging desktop computer video image 
capture, image compression, and compact high-resolution 
color display in the cockpit for the effective and efficient 
presentation of weather, air traffic control and other data to 
the pilot or flight crew. The contemporary improvement in 
satellite communications to aircraft, and deployment of 
improved weather collection and dissemination systems, 
coupled with a visual output display, makes a significant 
advance in operational communications possible. This pa- 
per shows through examples how visual output of graph- 
ics, including maps and imagery, could be used to advan- 
tage in the cockpit, not only to replace text, but to provide 
an improved systems interface to sensors providing real- 
time information. 

INTRODUCTION 

Current operational problems with commercial and mili- 
tary aircraft include maintaining or reducing congested 
corridor space (lateral, vertical, and along track) to im- 
prove system air trafTic capacity; changing flight trajectory 
in response to changes in weather and winds; and improv- 
ing flight safety. 

In the northeast corridor (North America to Europe), air- 
craft spacing of 5 minutes along track, 30 miles between 
adjacent tracks, and 2,000 feet in altimde between flight 
planes is met using a variety of techniques and systems. 
Real-time satellite communications and other enhance- 
ments are needed to reduce these spacings for greater air- 
space capacity, and to add more dynamic flight manage- 
ment for fiiel savings without loss of safety. 



EXPANDED PASSENGER COMMUNICATIONS 
Video to Passengers 

External communications service for airlines passengers 
was introduced with the installation of pay telephone ser- 
vices on large aircraft. Still not universally available, this 
service has nevertheless proven valuable to users and has 
served to identify a viable market. Consequently, interna- 
tional maritime satellite (INMARSAT ) is anticipating 
introduction of multiple channel terminals (i.e., four simul- 
taneous accesses) for aircraft. Over 200 commercial air- 
craft now provide single-channel access. 




Communal passenger viewing of video presentations has 
been common on long distance flights for two decades. 
Introduction ot individual viewing screens has begim for 
presentation improvement and allows program selection 
from a menu of several options. In addition, in-flight video 
merchandise shopping may be implemented on one chan- 
nel. This concept will enable new markets in entertainment 
and retail sales. It also foreshadows interactive computer 
communications availability to the passenger. The new 
capability mms on the availability of the solid-state flat 
panel color displays. 



Several airlines have announced plans for introduction of 
individual color display screens at passenger seats. These 
plans are summarized in table 1 . 



Date of Introduction 

1993 (announced 1992) 
1993 

1993 (contract 1992) 

1994 (trial 1993) 



Singapore Airlines unknown 



:t 1992 



A flat panel proposed for such use is shown in figure 1 . 
The display has been edited and represents a union of two 
products of Hunting Avionics, West Drayton, Berkshire, 
England. The LCD screen measures 6.1x5.8x1.5 inches 
(termed 5.7 inch screen, largest of three models) and pro- 
vides 240 X 720 pixels. (A touch keyboard has been 
inserted.) 

The introduction of video displays is a significant advance- 
ment for individual passenger communications, and the 
same body of technology could also be applied for im- 
provement of communications between air traffic control, 
airline operations and the flight crew. Announced plans 
suggest a disproportionate attention to passenger commu- 
nications in comparison to that for the cockpit. 



KEY TECHNOLOGIES 



Introduction of visual displays in the cockpit is enabled by 
several rapidly advancing technologies. These technologies, 
including liquid crystal displays, will be briefly outlined. 

Liquid Crystal, Flat Panel Color Displays 

Miniaturization of personal computers produced the laptop 
computer operated from batteries. First generation prod- 
ucts employed monochrome flat-panel liquid displays 
(LCDs). Current products incorporate color LCDs. 
An example packaged LCD product, possibly large 
enough for the cockpit, is the SEAL Touch flat-panel VGA 
Module measuring 10.2 inches x 12.26 inches x 2.8 inches, 
having 640 x 480 pixels, 5 1 2 colors and a power consump- 
tion of ~42 watts. This display is shown in figure 2. (The 
SEAL Touch flat panel VGA Module produced by Lucas 
Deeco, a division of Lucas Automation and Control Engi- 
neering, U.S. subsidiary of Lucas Industries pic. Slough, 
Berkshire, UK. SEAL Touch is a registered frademark of 
Lucas Automation and Control Engineering Inc.) 

Personal Computer Technology 

The personal computer, LCDs, compact disk read-only 
memory (CD-ROM) and digital still-video technology are 
applicable to cockpit vision. 



CD ROM provides ability to store maps in various resolu- 
tions in the cockpit. This may be employed to obviate 
transmission of map background data for some displays, 
reducing data or required data rates for satellite 
communications. 




Figure 2. SEAL TOUCH VGA LCD Unit 



Digital still-video technology — including charge coupled 
device (CCD) cameras, digital frame grabbers, and image 
compression products — also has potential roles in airborne 
environments, and is explored in a military context in ref- 
erence 4. Lightweight CCD cameras produce analog video 
signals in standard formats. Frame grabbers are imple- 
mented in chip sets and, provided as computer boards, con- 
vert a video to a still digital picture. The digital file repre- 
senting the single image can then be reduced in size by 
image compression. Large compression ratios can be 
achieved if truly lossless reception is not required. Most 
applications envisioned for cockpit vision do not require 
lossless transmission. Furthermore, many applications in- 
volve vector graphics that require significantly smaller file 
sizes (e.g., < 100 kbytes). 

Computer Supported Mission Planning and Training 

Mission planning can be accomplished with computer sup- 
port and by employing the same or closely related software 
used for in-flight air traffic control. The mission flight tra- 
jectory, en route weather, and other relevant factors can be 
incorporated into the plan. The plan file can be used to 
produce automatically a preflight briefing for the flight 
crew. Although beyond the scope of this paper, it i^ pos- 
sible to develop an interactive mission rehearsal using 
virtual reality technology to enable or enhance preflight 
training. 

Headup Displays 

Headup displays may be applicable to in-flight data pre- 
sentation in single and two place (small) aircraft, but is not 
considered applicable to large aircraft. 



Satellite Communications 

Introduction of worldwide L-Band satcUilc communica- 
tions service to aircraft can be confidently predicted. 
INMARSAT terminals are operational on over 200 com- 
mercial aircraft, and a number of domestic and regional 
aeronautical satellite communications systems are in ad- 
vanced stages of development. Further development of 
antennas and terminals will seek to reduce equipment and 
installation costs, while increasing the rate of terminal in- 
stallation. Thus, the assumed communications with aircraft 
in flight is via L-Band (~1 .6 GHz). Similar capabilities 
could be implemented using UHF (225^00 MHz) satellite 
communicatioiB for military aircraft. If the L-Band termi- 
nal is installed on military aircraft for other reasons, the 
need for UHF capability might be reduced. UHF has the 
benefit of low cost omnidirectional antennas, significant 
operational experience, and lower cost airborne terminals. 
Graphics and compressed pictorial image file size allow 
use of modest data rates for a single user. For air traffic 
control, a number of aircraft could be served by a single 
multiplexed broadcast channel. Thus, it might be useful to 
introduce a single broadcast channel for operational con- 
trol (flight deck communications). Such a channel could 
have a high burst rate of perhaps 200 kb/s, with time divi- 
sion multiple access. More fiequent updates for a danger 
situation could be accommodated by assigning more time 

Advanced Sensors 

Weather satellites and ground-based weather radars con- 
tinue to evolve. Duplication and overiap of data sets by 
alternative sensors can be used to provide smoothed data 

FLIGHT DECK COMMUNICATIONS 
ENHANCEMENT 

Introduction 

Operational ftinctions that could be implemented using 
LCD output would make use of the more direct and con- 
textual presentation inherent in a graphical or pictorial 
color display, in contrast to voice or text. While research 
on the man-machine interface continues, it is clear that the 
pictorial approach has achieved significant user acceptance 
in personal computers. Current product developments em- 
phasize desktop video and enhanced multimedia informa- 
tion presentation. This revolution will produce a body of 
commercial products that may be adapted for use in cock- 
pit visual displays. 

Some of the operational functions are discussed in turn. 
Presentation of Flight Plan 

The flight crew could be presented with a flight plan on the 
flight deck or in a briefing room prior to flight. The presen- 
tation could be computer generated to incorporate up-to- 
date weather, route congestion, and other data. The pre- 



flight briefing could provide mental context for in-flight 
updates. Common use of technology for development and 
plan presentation, along with in-flight communications and 
control, would result in both a more effective overall sys- 
tem and a reduction in training costs (including maintenance). 

Presentation of Weather Data 

It is significant that systems in use or under development 
for collecting weather data are all digital, or at least distrib- 
ute products in digital form. Furthermore, distribution sys- 
tems are moving increasingly to satellite digital form. For 
example, the U.S. Federal Aviation Administration now 
employs a (C-Band) satellite very small aperture system to 
distribute weather data collected by distributed ground- 
based weather radars. The data is broadcast and various en 
route traffic control centers can receive weadier data from 
multiple sites. The control centers generally interested in 
multiple weather radar outputs are not colocated with the 
weather radars, and the satellite broadcast has proven cost- 
effective. Satellite collected weather data is also widely 
used in aircraft operations, both military and civil. The 
U.S. Air Force operates the Air Weather Distribution Sys- 
tem (AWDS), which collects and processes weather and 
environmental data, and creates products representing in- 
formation synthesized from multiple sources. 
Figure 3 shows the streamlines or flow of winds over the 
United States, suggesting westbound flights could choose a 
flight path presenting lower headwinds. Figme 4 is a lower 
resolution wind speed chart showing considerable wind 
speed variation in the northeast corridor between Europe 
and North America. Figure 5 is a satellite infrared image 
clearly showing a tropical disturbance southwest of 
IVIexico (not shown in a visible spectrum image). Humid- 
ity, temperature and other products are available and the 
examples shown are typical weather products of interest to 




En Route Spacing 

The real-time control of aircraft, especially in the North- 
east corridor (Europe to North America), is a critical prob- 
lem for reasons of air safety, but also represents an oppor- 
tunity for improved operational efficiency. 
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With regards to safety, it is desired to maintain aircraft 
spacing at five minutes along track; and adjacent flight 
tracks are spaced at 60 miles. Position updates are col- 
lected at 2 minute intervals for aircraft in the northeast cor- 
ridor. A variety of systems including both over-the-horizon 
high-frequency (HF) radar and ionosphenc communica- 
tions have been employed in the attempt to maintain or 
reduce spacing. A given spacing established a maximum 
density or capacity of the northeast corridor or channel. 
Automatic dependent surveillance using GPS navigation 
satellites, together with satellite communicanons via 
INMARSAT, should make a significant improvement in 
the accuracy, precision, and reliability of input position 
data for airspace control. The critical information would 
then exist at ground facilities. A return link is needed for 
control. Furthermore, a collision avoidance system will 
eventually be provided to further enhance air safety. It 
would seem appropriate to provide a imified or fused dis- 
play of the information from the (ground-based) air route 
surveillance and airborne collision avoidance systems. 



Again, it is suggested that a visual graphical color display 
would provide the most useful representation of the data. 
Design of such a display is not trivial. In addition to repre- 
senting position and velocity along track and in adjacent 
tracks (essentially in one plane), display of information 
about the flight planes above and below are also necessary. 
Thus, the data represents a three-dimensional situation 
with at least two independent data sources. While alternate 
blinking displays could be used to separate the surveillance 
and collision-avoidance data, color might be used instead. 
Blinking might be used to identify potential hazards that 
violated a spacing or rate-of-closing criterion. 
A conceptual display suitable for color LCD is shown in 
figure 6. This version may serve as a point of departure but 
should not be considered as a final recommendation. The 
center strip represents the assigned flight track and the air- 
craft icon in the center represents the aircraft having the 
display. This aircraft is also the center of the coordinate 




system for the displayed data. Adjacent tracks are assumed 
to have aircraft assigned and the spacing is managed to 
maximize distance between flights. The current separation 
distance of on-line flights is annotated on the track. Posi- 
tions of aircraft on the next lower altitude plane are also 
shown. The icon indicates the direction of flight. For 
flights within a range threshold or exceeding a closing 
speed, a vector is drawn with the range or speed provided 
in numerical form. A military or civilian aircraft, not con- 
strained to fly along the air traffic control tracks or paths, is 
shown in figure 6. Its altitude, separation and closing speed 
are all annotated, because they violate assumed criteria. 
The most recent three positions of this intruding aircraft 
are shown. Finally, color and/or blinking could be used to 
annotate different altitudes (planes), or to designate most 
significant or nearest flights, etc. 

Since the data represents a three-dimensional situation dis- 
play, some form of isometric view could be employed A 
three-dimensional virtual reality display could also be usc 'i 
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Diverts 

Aircraft in flight may be diverted to a different airport for 
reasons of air traffic or weather, for example. Similarly, a 
pilot may be able to modiiy the planned flight trajectory to 
realize significant improvements in air speed, or reductions 
in fuel consumption. Real-time control in response to wind 
and weather would produce significant cost reductions and 
performance enhancements. 

Taxiways and Tarmac Parking 



Control of vehicles on the ground is also a critical safety 
problem. If technology allows reduced in-flight spacing, 
more frequency landings will result in increased ground 




traffic congestion. While locating the correct terminal gate 
would not normally be a problem for conmiercial passen- 
ger aircraft at large international terminals, it can be for 
significant cargo transport to smaller airports and in mili- 
tary airlifts. Depending on the speed of unloading prior 
flights, the optimum location for parking may change dy- 
namically as an aircraft approaches touchdown. At very 
small airports, parking spaces on the tarmac may be lim- 
ited. Figure 7 shows some details of tlie Ankara, Turkey 
airport. The symbols shown along the runway and taxiway 
indicate position fixes of a particular flight. Obviously, 
empty (or colored) symbols along the runways or taxiways 
may be used to indicate filled and vacant parking places 
that direct inboimd aircraft to the assigned location. 
Again, a visual display, or roadmap, is clearly superior to 
verbal or textual presentation. 



Training/Practice 

While the enhancements through graphics presentation of 
data to the flight deck is valuable in itself, it might be 
viewed as a portion of an overall improvement that em- 
braces pilot training, preflight mission practice, in-flight 
control and safety, in-flight weather monitoring, and land- 
ing and taxiing. The pilot training and mission practicing 
phases would be enhanced through virtual reality 
simulations. 

CONCLUSIONS 

Graphics and imagery can provide a powerfiil and effec- 
tive means of communications to the flight deck of aircraft. 
It is important that the technology for implementation ex- 
ists and is imdergoing intensive development and rapid 
improvement, which is in no way dependent on the appli- 
cation to the cockpit. Hence, the operational implementa- 
tion will enjoy steady improvement in performance, and 
reduction in cost. 

A broadcast fimction using L-Band, and perhaps most 
gracefully implemented through INMARSAT, is recom- 
mended for the downlink to aircraft. More detailed analy- 
sis of traffic is needed to estimate whether a special chan- 
nel is needed. Features of INMARSAT including spot 
beams, increased EIRP, and power management flexibility 
will facilitate implementation. Because of image compres- 
sion technology, it may be possible to accomplish the air- 
craft fleet broadcast channel for cockpit vision using con- 
ventional data rates widiout a special high power channel." 
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